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Abstract 



This paper describes a system designed for evaluating the performance 
of ESKA Title I Technical Assistance Centers. Topics covered include^ 
Center tasks and activities, a management information system designed to 
monitor activities in each task area^and utilization of this 
information. The system provides a means ^f monitoring the level of 
effort in each area and checking whether state and local education agency 
needs are being met* 
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Technical A.so iutanco Center 3 (TACs) havo been er>tabLished for each of 
tho ^ 'a tj.^ojraph io roqionsi of the Deprirtmont of Health, Education and 
VJolfar*}.. The TACn provide state education ago^noios with modals for 
evaluation and technical a^sisistance to enable them to annist local school 
di.strict^ in d-^v^^loping and applying systematic prpgram evaluation to 
Title I programs. The TACb for Regions 8, 9- and TO are located at the 
Northwr^st Regional Educational Laboratory in Portland, Oregon* The 
objcctiv-js of. this papt^r are to describe procedures for an internal 
evaluation of those TACs, and to discuss possible uses of the evaluation 
findings. 

An evaluation of TAG operations is potentially very significant* TAG 
operations in Regions 8, 9 and 10 affect over 2,000 state and local 
education agencies in the Western United States and Trust Territories. 
Improved services to these agencies may contribute to the quality of 
information available for educational decision making at the local 
level. This could be expected to have an effect on design of curricula 
and instructional techniques, and ultimately to help improve the 
education of those disadvantaged students in Title I programs benefiting 
from TAG consultation. Admittedly, the chain of inference from better 
and more effective delivery of evaluation services, to improved 
ovaluation, local decision making and raised achievement for students in 
tonuouf;. There are, in addition to evaluation services, many other 
factors which can have a significant effect on achievement. Local 
traditions of policy making may discourage the most effective use of 
evaluation data. Limited district resources, family situation or 
socioeconomic status of students may have such strong effects on 
achievement that they mask any effects brought about by improved local 
use of evaluation data. 

2/80 ^ 7412A 
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Several ta^ka for TACs hive been dj^scribed by the United Stater; 
Offic*» of KdiK'ition (Nol:e 1). An abridged version of those tasks follows: 

1. TACr. win undertake and regularly provide outreach and awareness 
activities to make GEAs and local education agencies (LEAs) 
aware of tht^ availability and scope of technical assistance 
activities. 

2. TACs will act as a technical consultant to SEAs and LEAs in the 
areas of evaluation planning, implementation, analysis, 
interpretation and reporting. 

3. TACs will participate in limited technical investigations 
pertaining to aspects of the Title I Evaluation and Reporting 
Systein (TIERS) . 

4. TACs will perform other tasks, at USOE direction, related to 
TIERS. 

5. TACs will maintain staff capabilities and expertise. 

6. TACs senior staff vill, as necessary, attend TAC Directors' 
Meet i ngs . 

7. TACs will sponsor periodic regional meetings of state Title I 
coordinators and designated TAC contacts. 

The first two tasks, outreach and awareness, and technical 
coaTultation constitute the bulk of direct TAC services to states, with 
thi> majority of the services falling in the technical consultation 
category. The focus of this evaluation is on direct TAC services to 
states. The scope and nature of services are negotiated with each state 
individually, and are formalized in a letter of agreement. The purposes 
of the agreement are to establish the scope of services, and the delivery 
system for providing these services to the SEA by the TAC, and to specify 
2/80 ^ 7412A 
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ways in which LKAs b-? contacted. In particular^ the following points are 
noqot-iatod: 

!• A TAG e:aploy.:o in do.-jlqnatod ar. th*:? primary contact wit.h the SEA. 

2. A minimum nunher of onr;ito staCE days are allocated to provide 
con.-^.ul tat ions to SEA or LEA staff on designated topics. 

3. A ir.ininuun nunber of onsite staff days are allocated for the 
provision of workshops on dosignatod topics. 

4. A mininiiirn ninnber of onsite staff days are allocated for the 
development of mater icils. 

5. A mLnimuin niimbor of onsite staff days are allocated for 
ai^r, irtanct? in addressing technical issues. 

In addition, a number of inhouse staff days can be allocated for 
certain of tho above tasks. In practice, much of the allocated inhouse 
time is used to prepare for tasks performed onsite. 

A stipulation in the request for a proposal to operate a Title I 
Evaluation Technical Assistance Center, issued by USOE in July, 1979 was 
that relevant information on TAG operations be collected and reported to 
USOE. Subv^equently , instruments were developed internally to collect 
information on delivery of services, and a computerized management 
information systam was sketched out in order to obtain whatever analyses 
would bo needed for reporting to USOE, and for internal uses. After the 
contracts were awarded, USOE issued a set of forms, to be completed 
monthly, which solicited information on workshops, onsite consultations, 
telephone calls and correspondence. Although the monthly report forms 
were developed primarily with USOE information needs in mind, it was felt 
that the information oould be used profitably to conduct an intern.al 
evaluation of TAG operations, with the ultimate goai of improving TAG 
^ 2/80 7412A 
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sor vices. In addition t.o a need to be nwaro of the current scope of TAC 
orx'r ntior.<i , information relevant to the following general issue was to bo 
coUectf^rl. At the .<;tart of the contract year , and in the proposal 
auNnittt.Hl to UHO?], a level of services was projected for each state in 
order to e.3tiinate budgets and plan resource allocation. At times there 
are discropi^ncies between the projected and actual levels of delivery of 
services. Given such discrepancies, do they imply a need for added 
resources? Or do they imply a need for additional planning and 
information (e.g., regarding materials developnent time, preparation and 
follow-up for onsite activities) in order to rationalize delivery of 
services? 

Certain specific questions relevant to this general issue can be 
posed. The first question is about the projected and actual level of TAG 
services in each state. The variable used to quantify delivery of 
services is termed level of effort. Level of effort can be 
operational i zed in terms of the number of days spent onsite in a given 
state, or in terms of the number of person trips to a given state. 
Estimates of the pojected level of effort can be abstracted from the 
letters of agreement signed with each state, and fron the proposal 
submitted to USOE. The actual level of effort expended can be obtained 
frcTT» records of travel. Given these definitions, the first question can 
be formulated: 

1. How does the actual level of effort expended in a state compare 
with anticipated levels? 

Stirly of resource allocation and use is helpful for diagnosing the 
cOTOunt of activity in states served by the TACs. However, it should be 
supplemented with information about the nature of TAG activities. The 
2/80 ''^^^A 



nature of activit.tir. Ctin bo opor ational i i:od in terms of a typology, 
which, in turn r^n bo a^iv* t riK;h**d to r^^fl ect oithor tho functions of TAG 
r.or vi Ci-'S , o- to reflect tho topicr* di.scu:: 'ocl in workahopt^ and 
consul ta^. inn ; . Given th\;o ty;x>loqios, lavr^l of effort can be 
opor gitionnli zod in terms o£ either tho number of contacts (including 
tolepliont*, cor rer,n:^ndonr:i} , and works h'>p) , or tho porsoA effort (for 
onint^? consul tat. ion::; and wocksbDpn only), where person effort is defined 
as the numS^r of hours spent performing a task multiplied by the number 
of TAC staff en«jiged in the task. Given these definitions, one can ask: 

2. H(Tv are resources, measured in terms of person effort, being 
exp-mded across functional categories? For what purposes are 
the TACs spending most of their time? 

3. How are resources, measured in terms of number of contacts, 
being expended across topical categories? 



METHOD 

Tnstrumentat ion 

Insttumonts used to gather data included the IJSOE monthly report 
form^, -ocords of travel, letters of agree-ment with states and the 
proposals submitted to USOE by the Reqion 8, 9 and 10 TACs. Brief 
doscr i ptiorui of those follow. 

The USOK monthly report forms (see appendix A) solicit information on 
telephone calls, cor r or. pon den ce , workshop-;, onsite consultations, 
materials do volf>pment , technical investigations and staff de velo}:nient . 
Contained i n t he form Is a typology of topics. Data for the internal 
evaluation wo e abstracted from the contact summary sheet anci ttcm logs 
of worksb:>f)3 and onsite con^uil tations (see appendix A). The contact 
2/00 7412A 
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summary shoet is a tabulation of contacts classiflod by topic. The logs 
for on*3ite a:^rv-;ul tat ions and worka}x>ps cr)ntain information on tho nature 
oE each contact and on TAG person effort • • These logs were analyzed to 
dt?tcir»iin^> what the function or. goal of each workshop or consultation 
wan. The following typology was acTopted: 

1. Assisting with reporting requirements • 

2* Assisting -.ith application or use of evaluation out canes locally • 

2. Minimizing error in the evaluation. 

4. Planning oE activities with SEAs and LEAs, 
5^ Other • 

Providing clients wi th assistance to meet reporting requirements 
involves primarily instruction in the correct application of USOB's 
guidelines for use with the evaluation models, familiarization with the 
report forms and guidance in filling out forms. Providing assistance 
with local use involves helping clients use evaluation data to make 
decisions about their programs. Minimization of error applies mainly to 
the use of correct procedures for administering and scoring tests and 
reporting the data. Planning refers to the negotiation of letters of 
agreement or to planning for on-site workstops or consultations. The 
"other" category might include such activities as consultation' on JDRP 
approval processes and on working with parent advisory councils. 

In sane cases it was evident that an activity had multiple purposes. 
It was deemed infeasible to question staff on the proportion of person 
effort allocated to each purpose for each activity. Therefore a rough 
(Estimate was obtained by dividing the person effort for *>ach activity by 
the nunber of purposes. This fraction was arbitrarily fixed and the 
aniount allocated to each function or purpose. While this method is far 
2/80 7412A 
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friin p'^^Ccjct it should h.> hol[>£ul ac> a rough guide to the amount of 
p:MT,cn] ofFort expi^nd-^d on oach function oc task. 

Data on tho nuinbor of clayr, .spent on^nto v/ar» obtained froii travel 

0 

autUu* i ?:a-: ioii fonn.s. 'Tlvj:i(» rc?cx*)rd3 v/ore ox:iniined to oi^n'itruct a ro£?ter 
of tho nunhor of pa»rson trip^ and por5;on dayc for each state. These data 
wore oxainin'-d by the Ar;sistant Director in charge of each region and 
correction^ were made where tb.jy were noedod. 

Obviourly, data fran the monthly report forms and from travel 
aut hori i^ation^; were not available For the entire contract year, since at 
the tim? of writing only three months of the year have passed. Travel 
authorization data are available for the first three month's, October, 
November and December, and monthly report data are available for November 
and December • 

A standard format waf> used for the letters of agreement, although 
there were slight variations frctn state to state, depending on the 
special needs of each state. In all letters the number of days spent 
onsite for various tasks is clearly delineated. These figures were 
summed for each state to obtain a total. The number of onsite staff days 
in the letter are for planning purposes only. In many cases in past 
years the actuil number of days provided was different due to changes in 
the needs of SEAs and LEAs which occurred after the agreements were 
signed. Changes can bo made in the letters by consent of both the TAC 
and t he state . 

Information on the number of person trips planned for each state was 
contained in the business propoGalf; submitted by each TAC. The estimates 
of numbers of person tripr. in tho proposals were based both on 
coasultation with states and on an examination of travel during the l:.»nt 
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contract yonr* Thr\^;o fiqurcn v^ere submitted in July 1979. Dy contrast, 
the lottocG of agreement wer^^ nogoticjtod in the fall of the yoar . Since 
the lt»tti?r of agrf.finent data aro^moro recent, tliey should he rogacded as 
inoro accurato. 

Setting , Tlie netting of the study is the Northwest Regional 
Education.:il Laboratory in Portland, Oregon, a private not-for-profit 
educational research and developnent laboratory. The TACs are ix>used in 
the Division of Evaluation, Research and Assesanent. They serve the 
follc^^ing states and regions, which are included in this study: for 
Region 8, Colorado, Montana, North Dakota, South Dakota, Utah and 
Wioming; for Region 9, Arizona, California, Hawaii, Nevada and the 
Pacific (including Guam, American Samoa, the Trust Territories and the 
Northern Marianas); and for Region 10, Alaska, Idaho, Oregon and 
Washington. Data in this study are presented in a format that preserves 
the anonymity of both states and regions. In each state professional 
staff might contact and provide services to either SEA staff, LFA staff 
or staff fron intermediate education agencies, such as the Board of 
Cooperative Educational Services in Colorado. There are about 17 
professional staff in the three TACs, most with experience in educational 
measuresTient , testing and evaluation, as well as teaching or 
admi ni.^trati ve experience in public school si'stems. 
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Rrsur/rs 

Ro.:;ults »»» e prtsotiVorl in th^ follcxvinn formal for th^=* oonvf>ni ence of 
tho ro.iflcr, Firiit, t ho ovaUntion que:^tion is stated. This is follnwed 

tlio duti.i rolov:uit to that qu^r, tion. Data on actiul expenditure of 
ro.souLc-?r> aro available for only part of tlje oontract year > so the usual 
cautions with regard to oxt rapolat Ion apply here. Hcwevf^.r , the first 
quarter ir> ncmcvhat typical of the ether three quarters of tb3 year in 
that It contains both periods of hiqh activity {Septomter and Oct.ober) 
and periods of reduced activity (December) . 

1. Hew does the actml level of effort expended in a state ODmparo 
with planned Ic Is? 

Firtit, data iiro presented for each region, aggregated across states. 
This is followed by data presented for individual states. The data in 
Table 1 n^xiw that with regard to both staff days and person trips, all 



JNS F RT TABLE 1 A B OUT HERE 

regions have spent less in the first quarter than one fourth of the 
plannod yearly amount. Overall, Region D*s expenditures are in closer 
agreement with what was planned than are expenditures for Regions A and 
C. Regarding days. Region C has expended about 58 percent of whit was 
planned. However, with regard to trips. Region C has expended about 83 
{x^rcent of what was planned for the first quarter. By contrast. Region A 
ha^> used up about 72 percent of the planned dai'S and 35 percent of the 
planned tripr>. Inspt>ction of Table 2 reveals that in most states the 



INSERT TABLE 2 ABOUT HERE 
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ninnb^c of npe*nt cliyn cind spent trlpr, is le:.3 than that originally 
pl<rin,!Ml, Hcvf^Vf^^r, for states 1, 6, 8, 9 and 13 the number of days apent 
crxa?i.*d.s the nunher planned, and for stcitos 9 and 15 the number of trips 
cp^n^ r^xcoocl^ that planned. 

2. Hew are resources, measured in terms of person effort, being 
expended across functional categories? 

Uata in Table 3 are given for the months of November and December, 
acjqri^gatod across regions in order to provide a global perspective on 
r';.*^ouroe allocation. Figures in the table are percentages, with a total 
person haurs figure given for each month. In November a little over a 
third of the total TAG person effort was focused on meeting reporting 
rpqui rement , with loss time being spent on minimizing error, planning and 
use,, in rank order. In December over half of the total TAG person effort 
was spent on reporting, followed by minimizing error, planning and use, 
in rank order. A two month average tears out that most time was spent on 
reporting, and the least tii^e was spent on use of evaluation results. 
Conparisons between figures for November and December must take into 
account an overall drop of about 46 percent in the aniount of person 
effort devoted to field activities. Apparently there is a reduced demand 
for TAG field services in December. 

The data in Table 4 are a tabulation of contacts for November and 
Dpcemher across the USOS topical categories. Each consultation, 
workshops telephone call or letter was counted in as many categories as 
was applicable according to guidelines under which TAGs are to complete 
monthly reports. Again these have been aggregated across regions in 
order to obtain a more global view of TAC activities. There was a 

l:i 

TnSERT table 4 ABOUT HERE 
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ch^cv^;\r.f} aU^ut 10 p^>rc*»^^ in t.ho niraher of contracts Fran 

Nov<*:Rb»M' Ir^ P-'c: vnl/»r , which \ (.xM)';i :;f'*nl v/lth the? cl«'>croa:-;o olx:;orvod in 
'iv^^)l" 1. '^h'^ ton cM'-^-'cjoric^'; (exHurlinq "oLht^r") jjhoyi'ng the mor»t 
aotivily, r.i.-j''. in oiC-^r on n two month avoray-":* of the nunter of 

o.>ntac;t:-> , .i^f^; plannin'j, dn^a pri>co:;si ncj , tont yoloction, other te?iting, 
obtaininj i nf or:nat i on P r-^n oth^fr TACc, Mf»'7^1 h, reporting, obtaining 
i nf o^;^.>^ Lop. from lUOK, providlnc} <jf*»noi'al information on TACATERS and 
c^\.\] i ty c^nt rn] . 



DIsaJSHIC>I 

Data in Tablo 1 arr> ui^oCul for (1) monitor- TAG expenditures for 
travol, (2) al/crting TAG to examine ponr.ihlp causer. For discrepancies in 
projected and actual levels oE service, e.g., seasonal fluctuations, 
changes in mode of service d»-*l i vc,»r y , reflections of state or local 
agencies' request for services. TACs will be more likely to detect 
d^anges in client needs or statu?r. given these data and, thus, more 
sensitive to needs to alter services, e.g., increase or decrease 
e.itimates or plan relativ:>ly f e^er but longer field trips. The results 
dij.playod in Tabl<? 2 ccnparing actual witli planned levels of effort 
indic-ato that more activity than originally anticipated is taking place 
in state:; I, 6, 8, 9, and 11. There are :;everal possible reasons for 
thif;. One oinild lio a change in a state's pJulosophy regarding TAG 
activitie:^. In state 13, for instance, SEA representatives have recently 
expres::ed an inter* or.t in permitting mor(» frequent ocjntacts between the 
TAC and IJAs. A different cau;;e could b^^ seasonal fl uct-uations in a 
particular state, d^^pending on SKA scheduling of TAC activities. This 
could be resp:)nsibl either for more activity than expected or less 
2/80 741 2A 
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activity th.m oxi>^ctoc1. Tho latter ponnihility iiv>y bo operatinq in r»t<nto 
11, for in.it:mr'». Tl-h'ro wolo r.evffrctl intensive wor kshiop awi mjs over the 
5U;.;ini'r in thiu state, which apparently saticfied iminerliato technical 
a:»?;i iitan''>» n.>vcl>. This har> 1 or! to a docline in the amount oE subs»?quent 
activity in this ntato. 

Wh^^re acti^il levels of oft'orrt suhn tanti ally exceed or are less than 
what was planned it would bc> u.>ef:al to reexamine the r elati oa^ihip of the 
ntate to i tr. TAC. It may \^ th.^t these discrepancies can be explained by 
contextual factors, such as in states 11 and 13. Or, where levels of 
effort ore le;3G than expected, it raay that the TAC is "working itself 
out of a job," in the sense that it is providing SEA staff with the 
ski! In needed to provide appropriate technical assistance to LEAs within 
the state and TAC services are no longer needed on a routine basis. Or, 
posr>ibly through i nadvertance , it oould be that needed services are not 
requested an<V<^^i^ delivered. 

Closer attention should be given to discrepancies between actual and 
pl^lnned numbers of .staff days than between actual and planned numbers of 
trips. The staff day data are more recent and based on the SEA's 
perception of need within the state. By contrast the person trip data 
arc several months older and are based in part on an extrapolation front 
previous years. However, the person trip data can be used to confirm 
trends in the person day data. 

Interpretation of the results in Table 3, showing the percentages of 
person effort expended in various functional categories in November and 
Decemt^r , should be tempered with the exp-^ct£tion that TACs will engage 
in different activities at different times of the year. For instanoe, 
during the first quarter of the oDntract year, October, November and 
Dec^nber, one would expect more time to be spent orienting U'JK staff to 
2/30 ''^UA 
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tu»w t»^p'>rt foi.u.; arul lucril.it ior\ . Thir, iii bonio oat by tho Table 3 
ro'iul L.;, whv*r»> ua avoruvp uf 47 porovMit f>r tho UotaL p-u'.ion (.»fLort: waG 
..p-Mit provi'Up. 1 .i>».;i-:»t.inc»» fvu* nu>i>tiiM roportinq L'oqui ro;aenLr». During 
th"* firiM thir^l (jinrttT:', v;h»^n fall and r>prinij to.'iting i.3 in- 

prcKn'**.5'>, ;.y^r»* t should be i^p^Mit on tonting and Lho appropriate 
cjiMlLty (:v>ntrol moa:»aror> for dara* Mor<i tim^.* dur;incj the £lr^3t quarter 
r>h'>uUl bo yp.^nt oa plcinaing than at othor tinio".3, ninco this is when 
l.->Lt*irn of aarooment wore nocjotiatod and plan*; tahl iuhod. The planning 
will pjobably uhift to tlio fourth quarter, for Gubsequont years. The 
VKr/.t appropriito time to help bKAr. plan for local ur>e of evaluation data 
would bo r^ith^r b^^foro tho fichool year beginr> or at the beginning of the 
year. This would fall in the third and fourth quarter. 

The d3cline of total person effort expended from November to December 
can b*:? in^.erproted an a r.oasonal effect. December is a relatively quiet 
month in that 5>choolB tend to be preoccupied with the end of the fall 
:^efnor>tor and with the forthvominy vacation. Certainly by December most 
of the fall testing ir> finished. 

Table 3 results may be a useful indication of SEA and LEA needs as 
percoivod by th-v^e agencios. This Is because many TAC activities are a 
response to specific requests originating in the states. Based on an 
admittedly restricted sample of d.ita, the highest priority seems to be 
satisfying reporting roiiuirements. Looking at a two month average of the 
figures, planning and minimizing error are approximately tied in 
import ince. Current interest in quality control and minimizing error can 
bo intr^rpreted in light of USOK interest in having LEAs and SEAs strive 
tn meet technical standards in implementing and reporting evaluations. 
K»^lat iv'.-^ly loss time has boon spent so far on exploring possibilities for 
2/80 1 7412A 



loCiil u.-.«? of evaluation cit comer.. Given that a common rationale for 
conduct incj ovaluationy is to produco data which are helpful in making 
pro.jraia docir.ions, this re.iult can bo interpreted a3 an indication of a 
need for a more deliberate effort to work on local uue. It will be 
holpfuL to study trends in this area to determine if the focus for TAG 
oocvices inoves toward use and away from reporting requirements. 

The rcGults of Table 4, showing a decrease in the number of contacts 
froin November to December, confirms the same trend shown in Table 3. 
""with the exception of those topics having to do with obtaining 
information from other TACs and Lrotn USOE, those topics with the greatest 
number of contacts can bo i'kiterpreted ac " those of greatest interest as 
reflected by freqnency, these do not reflect relative amounts of staff or 
TAG time to SEAs and LEAs. Again, this is because most TAG activities 
are in response to needs expressed from the clients. The first of these, 
data processing, involves methods for aggregating individual student data 
into classroom, district and state level reports. The relative emphasis 
on testing and test selection can be interpreted in light of USOE's 
guidelines for implementing the evaluation models, e.g.. Model A, many of 
which address testing practices. The results appear to show that most 
concern was with satisfying reporting requirements. Less emphasis is 
placed on finding applications of evaluation outcomes. 

It is proposed that data such as those presented in this discussion 
serve several useful purposes: 

1. They meet TAG requirements for reporting to USOE. 

2. Questions about the focus of TAG services are raised with 
implications for TAG objectives. 
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Lov->l5 i»f off orb can be inonitorod and bal anrc?d across ntatos or 
ac1ja';tod if nooded» 

Trend:; in TAC norvicor, can Iv^ analyzed for oonsistoncy with TAG 
pur pr^;e , 

Areivs for mahoria]:3 cVwlonuent or other TAC support can be 
identified via topi crs for TAC servicers. 
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Tablo 1 

ntaff n.-i and Tripr. p1 oiiaod anO 
Actiully J'ii-->nt- for Pirr;t Qutrloc by Pvrfjion 



Days TripG 
Plann ed Spent Planned Spent 



A 67. 7S 48. 50 56. 75 20.00 

fUKjinn D 8r,.7\) 79.00 29.00 23.00 

C 123.25 72. 00 37. 50 31.00 
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Tablo 2 

Staff Djya nnel Trips Planned and 
ActiHlly Spont for Firr.t Quarter by Stato 



nays Trips 

State Planne d Spent Planned Spent 

1 11. 75 16. 00 12.00 6.00 

2 25. 75 21.50 22. 75 8.00 

3 19. 00 5. 00 16.25 . 4.00 

4 11.25 6. 00 5. 75 2. 00 

5 24.25 14.00 6.25 5.00 

6 21. 25 24. 00 15. 25 11. 00 

7 17. 00 10. 00 2. 50 2. 00 

8 10. 50 11.00 4.00 3. 00 

9 13. 75 20. 00 1.00 2.00 

10 41.25 29.00 11.00 8.00 

11 18. 50 1. 00 3. 50 1.00 

12 3. 75 1. 00 3.00 1.00 

13 8. 75 12. 00 6. 50 6. 00 

14 2 7 . 25 11. 0 0 7 . 50 5 . 00 

15 23. 75 18.00 6.00 10.00 
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Table 3 

Porcont of Staff T-'icld Tim- by 
F{)cus v^r Ti>t:hnica] As/ji JJtanco 



9 



Foc:u n 



Novo nil) or 



Doceirbor 



Roporti n<j 



37% 



57'i 



An 



4% 



9% 



F. r t or 



22% 



9% 



IS. 5% 



Planning 



17% 



13% 



15% 



Othor 

Total or 
Fifl d Houri'. 



10% 



383 



17% 



206 



13. 5* 
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Table 4 / 
Niinbt>r of TAC Cont-acfcff by Topic 



Tot}ic 



November 



Providinq Information 
General Information 
Model A 
Mwlel B 
Model C 
Other Mof-lels 
F.nrly Childh'xxl 
N or D 

Needs Afis enonent 

Selection 

JORP 

PACs 

State Contracts 

Technical Investigations 

Quality Control 

Evalmtlon Planning 

Utilization 

Repor ti no 

Data Processing 

TetJt Selection 

Othi^r Testing 

Other 



24 
25 
7 

12 
0 
1 
3 
8 
1 
7 
1 
9 
1 
20 
9 
15 
21 
24 
18 
20 
59 



10 
12 
0 
6 
1 
3 
8 
4 
8 
1 
4 
11 
0 
9 
6 
3 
15 
15 
21 
18 
31 



Obtaining Information 
Other TACs 
USOE 

Test Publishers 
Planning 
Other 



10 
18 
0 

87 

34 



38 
36 
10 

108 

25 
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Refer en CG Note 

1, Request for Proposal: Tht> Operation of E3EA Title I Evaluation 
Tcchnlcil An.sintdnce Cenhorn, Washington, D.C: DHEW, Office of 
Educ*ition, July, 197 9. 
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R'Hj ion : 



Nuniber 


Number of Contacts 




Workshop 


On-site 


Telephone 


Letter 


l.O 


Providing Information 










1. 1 


General information on TAC/TIERS 










1.2 


Model A 










1.3 


Model B 










i .4 


Model C 












Alternative models 










1.6 


Early childhood education 










..7 


Neglected or delinquent programs 










1.8 


Needs assessment 










1.9 


Student selection 










1 10 












1.11 


PACa 










1.12 












1.13 


Technical investigations 






• 




1.14 


Quality assurance 










1»15 


Comprehensive evaluation 












pi ann i ng ( i nc lud i ng 












process evaiuacion; 










1.16 


Reviewing evaluation findings 












vuiiJLixny evaiuauxon ana uesu 












results 










1. 18 


Evaluation reporting issues 










1.19 


Data collection and analysis 










1.20 


Test selection 










1.21 


Other testing issues (e.g., out- 












of --level testing ^ score 












conversions, equating) 










1.22 


Other 










2.0 


Obtaining Information 










2.1 


Other TACs 










2.2 


USOE 










,2.3 


Test publishers 










2.4 


Others 










3.0 


Planning 










4.0 • 


Other 











or 



Table 2A 
Sumniary of Workshops 



Region: Month: Yoat 



Number of TAG Person- Number of 

Workshops Effort Clients 



TOTAL 



Table 3A 



Hc»<) ion: 



Sunimary of On-Site Activities 
Month: Year; 



Ctat^? 



Number of 
Act ivilioo 



TAG Poroon- 
Effort 



Number of 
Clients 



TOTAL 



I 
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1 

I n-iorksfiop lofj, Tabic 



On-SiU' Activity Log, Table 3B 
HtHjiuri: Month 



Year: 



{ 



Stii Iv : 



Contac t l\'rs(Mi 



Position/Ti tlc^ 



PhOPit' Nu:. ;l)C.'r : 



Md!tK2(s) or lAC staff present irv-j: 



TAC pf^rson effort 
Brief description 



HOURS 



Category number: 



Table 4A 
Summary of Telephone Calls 
Kocjioii: • Month: Year: 



State Number of Calls 



SEA LEA 



Total state calls 



Number of calls to TACs: 
Nun^ber of calls to/from USOE: 
Other calls: 




Tcble UB 
Telephone Loc 



TAG staff 



ReGion: 
Year: 



state or 


Date 


,K " ■ > n - -* 


' Check if 

TAG 
Initiated 


— — 7 oVT 

Subject X&v ^ 


ength 
5-10 


10 


.... 




1 
1 
1 














1 ■ ■ 1 ' ■ 

; ) 














! ! 
1 ; 

1 

L ■ : 













1 

■ ■ . . .1 ». 


i ! ■ i 














I - , - ^ 

1 

t : 

; 1 

1 : 












1 


1 : 


1 

, — 


— 

■ 

1 












1 

1 

i 


1 1 










1 


t 


1 : 
I 

i 














> { ' ^- - . 

1 

t : 1 
1 • 














1 1 — 

1 i i 

L _ , • ■ ■ 




1 

1 

1 











o 
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Table 5A 
Sununary of Correspondence 
Roijion; Month: Year; 



State Number of Contacts 



Sent to TAC Sent by TAG 



Total number of letters to and from SEAs and LEAs: 



Number of letters to.TACs: 
Number of letters to/from USOE: 
Other letters: 



Regicn 



Table 53 
Correspondence Log 
Konth 



Year 



1 i 

State or j Date ; 


Tuc Staff 


Client 


Chock if 

TAG 
Initiated 


1 ■ 1 1 ■ II ^ 

Subject 

■ 


Category 
No. 


















i ! 

t 

1 


1 










I 
1 

1 










I 

1 
1 










«— ^- ■ \' \ ' ' 

; 1 

! 1 i 








; 1 


1 ! 

i 




• 


1 

I 
1 










i 

! 


1 








i 










( 

• 1 










1 

1 












I 


! 










1 




1 

! 

1 _ 








J 

i 








- — 1 

! : 1 ! ' 




-24 


- i i 


i 

,,„.,.■ 1 i !■■ — . 


* 
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Biweekly Accounting for Monthly USOB Reports 
* Tables 6 through 9 



Staff 



Table 6 - Materials Developnient 
ilegion Month Year 


Material 


Principal 
Contributor (s) 


Brief 
Description 


Start 
Date 


End 
Date 












Table 7 - Technical Investigations 
Region Month Year 




Mater ial 


Principal 
Contributor (s) 


Brief 
Description 


Start 
Date 


End 
Date 






• 







Ron ion 



TOPIC 



tabid 8' - Regional and National Activities 

Month 



TAG ^•,'^'^FF 

AlTEMUIMG 



Year 



DESCRIPTION 



Peg ib\i 



Table 9 - Formal Staff Development 
Month 



DATE 
1— 



ACTIVITY 



ERIC 



Year 



PRESENTER (S) 



STAFF 
BRIEFED 



DESCRIPTION 



3^- 



WWHhl rAC CowUU'A Loy 
Date of t;i*MMi;t 



State 



(n;:n:r:) 



)M ^ I AC C 



f ar)M I j lAC 
I)UHA1U)N 



liF s , imn 



rjuiPb»?r i»f I AC St*iff 



fMun»l>ttf of Diuincts 



AdfTuniMf atof s 



_ OUiw 



Additiuiuil HtMp. Followup Pl.inne<l 



[ ) Moro Ot?taiIs on Bcicksuie 
( I Aiklitional Summary ^Re|>ort Attached 
[~) IMan.e List Attached 
Agenda Attached 



les to 



f ) Workshop/Prusontation Nueds Revision 
I } Cortain Hiindouts/Media Need Revision 



ERIC 



NWREL/TAC Representative(s) 



(All That Apply) 



.Date 



OtTAILS OF THE CONTACT 
Additional Sunmiary/Detaits: 



AiKlie.u;ij/P.Miii:ip,4ius' RtMCtions to HiiadoMts/AV Aids 



Hhjh Puuits l.(Kv Pi)ints of WiMkshoj- Pn.'SfMitation; 



Suinj«:s?i')ns tor ro»^xi Vi'ofkshop 'Presfiulation Tuanv. 



